arXiv: 1504.06185v3 [math.ST] 7 Nov 2016 


On Locally Dyadic Stationary Processes 

Theodoros Moysiadis 

Institute of Applied Biosciences, Centre for Research and Technology Hellas 

and 

Konstantinos Fokianos 

Department of Mathematics & Statistics, University of Cyprus 

Submitted: April 2015 

First Revision: April 2016 
Second Revision: September 2016 

Abstract 

We introduce the concept of local dyadic stationarity, to account for non-stationary time se¬ 
ries, within the framework of Walsh-Fourier analysis. We define and study the time varying 
dyadic ARM A models (tvDARMA). It is proven that the general tvDARMA process can be 
approximated locally by either a tvDMA and a tvDAR process. 
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1 Introduction 


The concept of stationarity is crucial in the statistical theory of time series analysis, especially 
for the development of asymptotic theory. However, the assumption of stationarity is often not 
realistic in applications. For example, a time series can display significant changes through time 
and therefore stationarity is a questionable assumption. One of the most important consequences, 
is that attempts to develop asymptotic results are, generally speaking, groundless, since future 
information of the process does not necessarily contain any information regarding the present of 
the process. In addition, there is no natural generalization of stationarity to non-stationarity, since 
non-stationary processes might exhibit trend or/and periodicity and other types of non-standard 
behaviour. 


Priestley! (1 1965h considered non-stationary processes whose characteristics are chan ging slowly 


over time and developed the theory of evolutionary spectra (see 


Priestley 


(I1981L 


19881) 1. However, 


such an approach makes it difficult to obtain asymptotic results, which are needed for develop¬ 
ing estimation theory. In order to apply standard asymptotic theory for non-stationary processes, 
Dahlhaus, in a series of contributions, introduced an appropria t e theoretical framew ork, based 


on the concept of local stationarity (see, for example, [Dahlhaus! d 1996b . 


1997. 


20001) ). Thedef- 


inition of local stationarity is 


(Dahlhaus 


dl996bl) ). [Dahlhaus 


5ased on the existence of a time varying spectral representation 


(!2012!) gives an excellent and detailed overview of the theory of 


locally stationary processes. A comparison b etween the methodology developed by Dahlhaus 


and Priestley is discussed in 

Da] 

ilhaus 

(1996a). Some other works related to 

ocally stationary 

time series include tl 

le wor 

cs 

by 

Granger and Hatanaka 

(19641 

. TiPstheim 

(1976 


Vlartin (1981). 

Melard and Schuttei 

(1989 

), 

Neumann and Von Sachs ( 

1997), 

Nason et al 

(2000) 

. Ombao et al. 

(2002). Sakivama and Tanieuchi 

(2004) 

and Davis et al. 

(2006 

), among others. 


The main goal of this contribution is to utilize the idea of local stationarity, in the sense of the 
above mentioned papers, for studying the spectral behaviour of time series, based on the system of 
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Walsh functions. These funetions led to the development of Walsh-Fourier (square wave) analysis, 
just like the sinusoidal functions led to Fourier (trigonometric) analysis. The motivation behind 
Walsh-Fourier analysis was the need to approximate stationary time series, whic h display square 


wavef orms with abrupt switches (e.g. in communieations and engineering), see 


Stankovic et al. 


(1200511 for instanee. We introduee the eoneept of loeal stationarity but based on the orthogonal 


system of Walsh funetions to aeeount for sueh phenomena that exhibit, in addition, non-stationary 
behaviour. We study important gene ral elasses of time series, similar in concept with the time vary¬ 


ing ARMA (tvARMA) proeess- see 


Dahlhaus 


(I 2 OI 2 I 1 . We antieipate that our theory and methods 


will be applicable to non-stationary data observed in diverse applications li 


for binary images, linear system theory and other ( see 


The Walsh functions were introdueed by 


Stankovic et al. 


ce pattern recognition 


(1200511 . for more). 


Walshl(ll923h . They take only two values, -fl and —1, 


and have similar properties with the trigonometric functions (although they are not periodic). The 
introduction of Walsh functions has been followe d by a series of papers, related to their mathemat¬ 


ical properties and generaliz ations ((Fine 


various applications, see e.g. 


others. 


BeauchampI (Il984l . 


(1194911 ). which 


provid ed t he theoretical frame work for 


Stoffen ( 1991 1 and 


Abbasi et al. 


2012h . among 


Stoffen (1199 ih gives an excellent account of the history of Walsh functions and a compari¬ 


son between Walsh and Fourier analysis. 

The statistical analysis of stationary time series via Walsh functions has been based on real 
and dyadic time. The dyadic time is based on the concept of dyadic addition (see Subsection 
2T]). For time p oints m, n, the real time sum m -f n is now replaced by the dyadic sum m ® n. 


MorettinI (I198111 reviewed work on Walsh spectral analysis in both t ime sca les . Walsh-Fourier 


ana 

and 


ysis of real time stationar y processes has been studied by 


Stoffed ( 198.51 


1987, 


KohnI (!l980allbh . 


MorettinI (Il983ll 


199011 . among others. The dy adic time stat ionarity is defined in respect to 


the real time stationarity as in Subsection l2.2l (see also 


Nagail (I l977hl. Further references re l ated to 


the Walsh-Fourier analysis of dyadic stationary processes are 


MorettinI (11974 . 


1978, 


mil), 


Nagai 
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(Il980h . iNagai and Taniguchil (Il987h and IXaniguchi et alJ (Il989h . In particular, iMorettinI ([1974, 


1978h studied the finite Walsh transform, eonsidered t 
Walsh spectrum and studied its theoretieal properties. 


le Walsh per iodogram as an estimator of the 


Nagail (1 19771) proved that a dyadie stationary 


process has always unique speetral represe ntation in t erms of the sys t em of Walsh functions and 


studied the dyadie linear proeess (see also 


MorettinI (Il974l) ). 


Nagail (Il980l) also studied dyadie 


autoregressive and moving average proeesses and their relation. 

In this artiele, we introduee the eoncept of loeal dyadie stationarity and diseuss the advantages 
and the perspeetives of sueh eonsideration in the framework of Walsh funetions. In Seetion 2 of 
this artiele, we recall some definitions and review some fundamental results for dyadie station¬ 
ary proeesses. In Seetion 3, we introduee the eoneept of loeal dyadie stationarity and study the 
time varying dyadie moving average proeess. In Section 4, we define the general elass of time 
varying dyadie autoregressive moving average proeesses and show that they exhibit loeally dyadie 
stationarity. The artiele eoneludes with several remarks eoneerning further researeh in this topie. 

2 Preliminaries 


2.1 Dyadic addition 


We reeall the definition of dyadie addition and of a dyadic process following 


Kohnl(ll980al) . Con¬ 


sider m and n to be non-negative integers that have the following dyadie expansions 

/ / 

m = E n = E nfc2^, where Uk G {0,1}. 

k={) k=0 

Then, the dyadie sum m © n is defined as 


m © n = 


|mfc - nk\2^. 


k=0 
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Consider now x and y to be real numbers that belong to the interval / = [0,1). We write 

OO OO 

^ = X] y = ^ yk‘2~'", where Xk, yk e {0,1}. 

k=l k=l 

In general, eaeh of the above representations is not unique. We follow the eonvention that if, 
e.g. x, ean be written both through a finite or an infinite order representation, then ehoose the 
representation where = 0, V /c > /cq • With this eonvention, the dyadie sum a; © r/ is defined as 


x®y = ^^\xk - r/fc|2 

k=l 

Reeall that the k-th Rademacher funetion is (j)k{x) = (—\/x G I,\/k > 0. Then the 
system of Walsh funetions, W{n,x), n = 0,1, 2,. .., a; G /, is defined as follows. If n = 0, set 
W (0, a;) = 1, Va; G /. For n > 0 , let n = 2 "^i + 2 "^^ 2^-'^ where 0 < ni < n 2 ■ ■ ■ < n,y . 

Then 

f 1) n = 0, 

W{n,x) = l Wxel. 

y (j)niix)(j)n2ix)---(j)nAx), U > 0, 

We mention briefly some eharacteristic properties of the Walsh funetions. 

(i) The system of Walsh funetions is orthonormal in I, that is 


W (n, x)W{m, x)dx 


1 for n = m, 
0 for n 7 ^ m, 


and eonstitutes a eomplete set. If f{x), x G / is a square integrable funetion, then it ean be 
expanded in a Walsh-Fourier series, i.e. 

OD 

/(^) = ^CnW{n,x), 
n=0 

with Cn = fg f(x)W(n, x)dx. 

(ii)Vn,m G N,a;,r/ G /, W{n,x)W{m,x) = W{n®m,x) and W{n,x)W{n,y) = W{n,x®y). 
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The above properties of Walsh functions motivate the study of stationary time series in terms 
of this basis. It is well known that a second order stationary process {Xt, f G M} is represented as 

J —TT 

with {Z{\), A G (— 00 , cx))} an orthogonal-increment process such that 


E{dZ{X)dZ{lL}) = T]{X - fi)dF{X)dfi 


where r]{-) is the Dirac fu nction periodica' 


distribution function (see 


Brillingerl (Il974t) . for instance). 


ly extended to M with period 2ti and F(-) is the spectral 


The Walsh functions can be used instead to represent Xt under the concept of dyadi c station 


arity. There are differences though between real and dyadic stationary processes; see 


Morettin 


(119811) for further discussion. The concept of dyadic stationarity is explained briefly next. 


2.2 Dyadic stationarity 

We call a stochastic process {Xt, f G M} dyadic stationary if it has constant mean, finite second 
moment and its covariance function 


R{n,m) = cov{Xn,Xm) = E[{Xn - E[Xn]){Xm - E[X^])], n,m G N, 


is invariant under dyadic addition, i.e. it depends only on n © m. Hence, we write for notational 
convenience R{t) = R{n, n © r). In the following assume that E[Xt] = 0, E[X^] = 1, Vf G N. 
We recall some important results about dyadic stationary processes. 


A dyadic stationary process Xt has a dyadic spectral representation given by (IMorettinl (11974 
p. 193)) 


Xt= W{t,x)dZxix), teN, 

Jo 
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where {Zx{x), x G /} is a real random proeess with orthogonal inerements, sueh that 

E[dZx{xi)dZx{x2)] = rj{xi ® X2)dGx{xi)dx2., 


where r]{-) is the Dirae funetion periodieally extended to M with period 1. The funetion Gx{-), 
defined on I, is a unique distribution funetion, whieh is ealled the dyadie speetral distribution of 
the proeess Xt. In addition 

— [ W{t, x)dGx{x). 

Jo 

If Gx{-) is absolutely eontinuous, then dGx{x) = gx{x)dx, where gx{x) is ealled the dyadie 
spectral density of Xt. 


Example 1. A simple example of a dyadic stationary process is a sequence {st, f G N} of inde¬ 
pendent random variables with E{et) =0 and E{et) = cr^, V f G N. It is straightforward to show 
that its covariance function is 

if r = 0, 

0, ifr^O. 

Since the sequence St is dyadic stationary, it has a dyadic spectral representation of the form 


E (^n^^nSr) 


£t= W{t, x)dZ^{x), f G M, 


with 


E[{dZ^{x))‘^] = dGs{x) = a'^dx, x G /. 

This example illustrates the analogy of dyadic and real time stationary processes. Indeed, it is well 
known that a white noise real time process possesses a flat spectrum; the same is true under dyadic 
stationarity. 


A stochastic process {Xt, f G N} is a linear dyadic process if it can be represented as (IMorettin 

(llQvi l 

OO 

^ ^ ( 1 ) 


k=0 


1 




where e* is the sequenee of i.i.d. variables, as in ExamplefH and {a^, fc G N} are real numbers, 
whieh satisfy ai < oo - This definition is similar in spirit to the definition of the general 


linear process 


PriestlevI (11981 


,p.415). 


It can be shown that a linear dyadic process of the form ([T]) is dyadic stationary, because 


[ cr x) I dx. 

k=0 


( 2 ) 


In addition, it has an absolutely continuous dyadic spectral distribution function and its dyadic 
spectral density function has the form 

g{x) = a'^ ('^akW{k,x)^ = a‘^A^{x), (3) 

\fc =0 / 

where A{x) = YlT=o a:). In this case, note that G{x) = cr^ A^{y)dy, for x e I. Again, 

we note the analogy between real time and dyadic statio narity; the above formula is identical to the 
formula obtained in the real time linear process model (IPriestlevI (Il98lb l. Furthermore, if 7 ^ 0 
and Ofc = 0 , V fc > g in ([T]), then Xt is said to be a dyadic moving average process of order q, 
abbreviated as DMA(g). In general, the process Xt defined by ([T]) is called a DMA(oo) process. 


3 Local Dyadic Stationarity 

Consider now ([3]), and suppose, for example, that the function A(-) depends upon time, i.e. it has 
the form r(-), where T denotes the sample size. Xt is now reexpressed as a triangular array 
Xt^T- We rescale A* r(-) from the axis of the first T non negative integers (t = 1, 2,..., T) to the 
unit interval I. The reason for this rescaling will be clear later on. The rescaled form of A* r(-) is 
denoted by A (f/T, •). We give a g eneral definition regardin g local dyadic stationarity for a process 


Xt^T, in the spirit of Dahlhaus ('e.g lDahlhaus 


(1996b. 


19971)). 
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Definition 1. A sequence of stochastic processes t = 1, 2,..., T} called locally dyadic 

stationary with transfer function and trend function //(•), where and /i(-) are deter¬ 

ministic functions, if there exists a representation 

= l' x)A^T{x)dU{x), (4) 

where the following hold: 

(i) U (x) is a real-valued stochastic process on I and 


cum{dU{xi ),..., dU{xk)} = q{xi © 0:2 © ... © Xk)gk{xi,... ,Xk-i)dxi ,..., dxk, 


where cum {...} denotes the k-th order cumulant, gi = 0, (72(2^1) = 1, \gk{,xi,... ,a:A;-i)| are 
bounded for all k and p{-) denotes the Dirac delta function periodically extended to M with period 

1 . 

(ii) There exists a constant K and a function A : [0,1] x M —)■ R such that 


sup 

t,X 


At Ax) -A\-,x 


VT. 

- 


(5) 


The functions A{u, x) and p,{u) are assumed to be continuous with respect to u = t/T. 


The above definition is analogous to the definition given by 


Dahlhaus 


(Il996bh . The first condi¬ 


tion states that the U (x) has rnoment s of order fc; the functions gkf) are the {k—l)-th poly spectrum 


of U(x) following 


BrillingeTi (119651) . The second assumption requires that the transfer function 


A. 


t,T[ 


is approximated locally by a function A{t/T,-), which is the transfer function of a dyadic 


stationary process. Note that the continuity of A{u, x) and p{u) in u is required for the process 
Xt^T to exhibit locally dyadic stationary behaviour. Furthermore, without loss of generality, we 
assume that g 2 {x) = 1 because the transfer function can be always rescaled such that the process 
{U{x),x e /} is white noise. Indeed, the boundedness assumption of g 2 {.) implies again ([5]) for 
the rescaled transfer function. 
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Example 2. Suppose Yt is a dyadic stationary process with dyadic spectral representation 


Yt= / W{t,x)A{x)dZ{x), 

Jo 

where E\Z'^{x)\ < oo, V/c > 0 Define Xt^T by 

Xt.T = A (^) + ■^ [f) y<. 

where yu(-), a{-) are continuous functions defined on J —)■ M. Then 

=/i + j W{t,x)At^T{x)dZ{x), 

where At^rix) = A{t/T,x) = a{t/T)A{x) and the assumptions {i) and {ii) are satisfied. Hence 
Xt^T is locally a dyadic stationary process. 


Consider now the process {Xt^x, t = 1,2,... ,T} 

OO 

Xt,T = ak,t,T£t®k- 


( 6 ) 


k=0 


where et is an i.i.d. sequence and {ak,t,T, A; G N} is a time-dependent process of real numbers 
such that Vf, YJxk=o^‘itT < We call this process a time varying dyadic moving average 
process of infinite order (tvDMA(cx))). If we set in ® o,q,t,T 7 ^ 0 and ak,t,T = 0, Vfc > g, Vf, 
then we call Xt^x a time varying dyadic moving average process of order q (tvDMA(g)). We 
rescale now the parameter curves ak^T to the unit interval I, assuming that there exist functions 
ak{t/T) : I —)■ M that satisfy ~ aAt/T). We further assume that aA-) satisfy some regularity 
condit ions (see Remark O. The reasons for the rescaling are described in detail, e.g. in 


Dahlhaus 


(120 121 Sec.2). Briefly, suppose that we choose ak,t,T to be polynomials of t. Then, as f ^ oo, 
a‘k,t,T —)• oo as well, which violates the condition ^k,t,T < addition, rescaling enables 

us to impose smoothing conditions through the continuity of the functions ak{ ), ensuring that the 
process exhibits locally dyadic stationary behaviour. Indeed, the number of observations within 
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the neighbourhood of a fixed point Uq E I inereases as T —)■ cxo enabling to develop and apply 
loeally for Xt;T asymptotic results for dyadic stationary processes. Suppose that the process Xt^T 
defined by ® is written as 


OO 

Xt,T = Ofc 
k=0 



£t®k- 


We assume that ak{u) = 0^(0) for m < 0 and ak{u 
satisfy some standard smoothness conditions; see 


= gj-fl) for u > 1 and that the functions ak{- 


Dahlhausl (Il997h . Consider now a fixed point 


Mo = to/T and its neighborhood [mq ± e]. If the length of this segment is sufficiently small, the 
process Xt^r can be approximated by the process Xt{uo), which is defined as 


k=0 


where Uk 


un) ar e constants, with uq indicating their dependence from the fixed point uq (see also 


Dahlhausl (12012h l. Xt{uo) is dyadic stationary. Indeed, we can write 


Xt{uo) = / W{t,x) l'^ak{uo)W{k,x)] dZ^{x) = W{t,x)A{uo,x)dZ^{x), (7) 


, fc =0 


where A(mo, 2 :) = Y.'k=o^k{uo)W{k,x). 

From equations I© and ([3]), Xt{uo) has covariance function 

R{uo,t)= / W{t,x) {a'^ak{uo)W{k,x)\ dx, 

\ k=0 

and a unique dyadic spectral density function given by 


g (mo, x) = cr ^ Ofc (mo) W{k, x) = a'^A^ (mq, x) , 


k=0 


where mq indicates the dependence from a fixed point. 

We can show that for {u = t/T : \t/T — mqI < c}, it holds \Xt^T — Xt{uo)\ = Op{l/T), see 
Corollary [U Therefore, we can say that Xtg- has locally the same covariance and dyadic spectral 
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density function as Xt{uo) and therefore exhibits locally dyadic stationary behaviour. Note that 
the tvDMA(cx)) process Xt^T in dH) is locally dyadic stationary due to Definition [U since it has a 
time varying spectral representation as in dH). Indeed, we have 

°° / rl \ rl 


Xt,T — 


^ y W{t®k,x)dZ^{x)j 


W(t, x)At^Tix)dZ^(x), 


where At^rix) = J2T=o (^k,t,TW{k, x) is the time varying transfer function. We show in Theorem[T] 
that, in general, a locally dyadic stationary process is approximated by a dyadic stationary process 
within a given interval. 


Theorem 1. Suppose that {Xt^r, t = 1,2,... ,T} is a sequence of stochastic processes which 
satisfy a representation of the form dH) where At^xix) is the time varying transfer function (set 
p (t/T) = Oj. Suppose that {Xtiuo), t = 1,2,... ,T} is a dyadic stationary process with 


Xtiuo) = [ W(t,x)A(uo,x)dU(x), ( 8 ) 

Jo 

where A(uo, x) depends on the fixed point uq G I. Then within an interval (mq ± e) and under the 
assumptions of DefinitionUjit holds that 

\Xt,T-M'>^o)\=Op{l/T). 

Proof. From equations dll) and dS]) we have that 


\Xt,T - Xt{uo)\ = 


W{t,x)At^T{x)dU{x) — / W{t, x)A{uo, x)dU{x) 


< / \W{t,x)\ ■ \At^T{x) - A{uo,x)\dU{x) 


\At^T{x) - A{uo,x)\dU{x), 


(9) 
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since W{t,x) G { — 1,1}. In addition 


\A,t{x) - A{uo,x)\ < 


At,T{x) - A y-^x 
K 


+ 


A[j;,x] - A{uo,x) 


< — + |A(m,x) - A(mo,x)| , 


( 10 ) 


from ([5]) in assumption (ii) of Definition [B However, the same assumption states that A{u,x) is 
eontinuous. Therefore, since {u = t/T : \t/T — mo| < e} and for any e' > 0 we can choose e > 0 
to be such that \A (m, x) — A{uo, x) \ < e', (fTOl) becomes 


\At^T{x) - A{uo,x)\ < 


( 11 ) 


for some positive eonstant K*. Finally, from dH) and (fTTl) . we obtain that 

E\X,^t-Muo)\ = 0{1/T), 


and hence we have the desired result. 


□ 


Corollary 1. TheoremUlholds for the tvDMA{oo) process Xt^T, defined by db]), since this process 
satisfies the assumptions of Theorem\T\ for Xfinf) given by dZ]). 

Remark 1. Theorem\I\implies that a locally dyadic stationary process could be approximated by 
dyadic stationary processes within different intervals in I (that may overlap). Thus its behaviour 
could be described via the behaviour of those dyadic stationary processes. 


Remark 2. Equation d5]) implies a similar assumption for the sup fik^T — 

t^X 


discussion still holds. 


ak{t/T) \ and the above 


Example 3. Consider, for example, the infinite time varying MA (tvMA(oo)) representation ^ = 
^^0 o.k,t,T^t-k, in the real time. Then its time varying spectral density function is given by 

( OO 

y^afc(u)exp(-iAfc) 

k=0 
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Figure 1: The time varying speetral density funetion for the tvMA(l) proeess (left) and the time 
varying dyadic spectral density function for the tvDMA(l) process (right). 

Respectively, the time varying dyadic spectral density function of the tvDMA(oo) is given by 

( OO 

a'^ak{u)W{k,x) 

k=0 

We compare the behaviour of functions g{u, x) and f{u, A) for the same order of the respective 
processes and for the same representation of the time varying coefficients ak{u) (set cx^ = 1). 
Figure [U shows the spectral density function of a tvMA(l) and tvDMA(l) processes. We set 
ao{u) = —1.8 cos(1.5 — cos(47rM)) and ai{u) = 0.81. Figure [2] shows the spectral density function 
of a tvMA(2) and tvDMA(2) processes. In this case we set ao{u) = 1.2cos(27rM), ai{u) = 
2 cos(1.5 — cos(87rM)) and a 2 {u) = u. Both figures reveal the differences between real and dyadic 
stationarity. The square waveform of Walsh functions allows a more oscillatory behaviour of the 
dyadic spectral density function. 
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Figure 2: The time varying speetral density funetion for the tvMA(2) proeess (left) and the time 
varying dyadic spectral density function for the tvDMA(2) process (right). 


4 tvDARMA processes 


It is well known that autoregressive, m oving ayerage , and ARMA models can be regarded as 


special cases of the general linear process. 


Nagail (Il98flt) shows that a dyadic autoregressive process 


of finite order is always inverted into a dyadic moving average process of finite order, and vice 
versa. We obtain similar results, but within a time varying framework. We define the time varying, 
dyadic, autoregressive, moving average (tvDARMA) process as follows. 


Definition 2. A stochastic process {Xt, t = 1, 2,..., T} is called tvDARMA{p, r) if it is locally 
dyadic stationary and can be represented by 


P r 

'y^^bk,t,TXt(Sk,T = 'y^^an,t,T £t®n, ( 12 ) 

k=0 n=0 

where p,r E with p = 2"^ — 1, r = 2-^ — 1, the sequences of parameters {hk,t,T}k=o,i,...,pi 


15 





{on,i,T}n=o,iv -,p numbers with at least two non-zero parameters bkQ,t,T, Ono,t,T for 2™“^ < 

fco < 2™ — 1 and <nQ<2^ — l. In addition, {st, t = 1,2,... is an i.i.d. sequence with 
E{et) = 0 and E{ef) = 


Assume that hQ^t,T = ao,t,T = 1- If we set in (fT^ . p = 0, then the tvDMA process arises as in 
dH), but for a finite order r. In case we set in (fT^ r = 0, then (fT^ becomes 

p 

'y^bk,t,TXt^k,T = gt- (13) 

k=0 


We call Xt^T in (fTSl) a time varying, dyadic, autoregressive process of order p (tvDAR(p)). We 
show that a tvDAR process, and even more generally, a tvDA RMA process, can be approximated 


by a tvDMA process. Following iNagai and Taniguchil (119871) . who study multivariate dyadic sta¬ 
tionary processes, set 

p 

X el, (14) 

j=o 


where p = 2™ —l,m G M and nre real numbers. Denote by ^ the (p+l)x(p+l) 

matrix, which is given by 


Sf.T — 


/ 


bo®0,t,T 
bieo,t,T 


boei,t,T 


y bp®o,t,T bp(Qi^t^x 

Lemma 1. The following equation holds 


bo®p,t,T 

bi®p,t,T 

bp(^p,t,T J 


p 

detpt^r] = 

j=0 


where Xj = j/(p+l), j = 0,1,... ,p. Therefore the function ft, t{.x) 0 ifandonlyifdet\^t,T\ 7^ 

0 . 
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Lemma 2. Assume that (j)t,T{x) ^ 0 in (fT4l) . Then there exists a function rjt^Tix), which is defined 
by 

p 

Vt,T{x) = '^dm,t,TW{m,x), {dm,t,T}m=0,l,...,p G M, X G /, 

m=0 

and satisfies = 1- The coefficients dm,t,T are uniquely determined by 

^t,T do^t,T di^t,T • • • dp^t,T ) ~ ( ^ 0 ■ ■ ■ 0 ) • 

Define St^r to be the (r + 1) x (r + 1) matrix 



®oeo,t,r 


®0®r,t,r 

St,T = 





y ®reo,t,T 

Orei.t.T • 

^r0r’,t,T J 


The following theorem states that a tvDARMA proeess ean be approximated loeally by a 
tvDMA and a tvDAR proeess. 

Theorem 2. Suppose that = 1,2, ...,T} A a tvDARMA{p,r) as in (fT^ . Set p = 

max(p, r). Then the following hold 

(i) 7/'det[St r] 7 ^ 0, then Xtq- can be approximated locally by a tvDMA{p) process. 

(ii) 7/’det[S't r] 7 ^ 0, then ^ can be approximated locally by a tvDAR{p) process. 

Corollary 2. Suppose that {X^ r, t = 1, 2,..., T} A a tvDAR{p) as in (fT3l) . 7/'det[Ej-r] 7 ^ 0, X* ^ 
can be approximated locally by a tvDMA{p) process. 

Proofs of these results are given in the appendix. 
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5 Conclusions 


We anticipate that the above results will be useful for future work in the field of applications. In 
this direction, the concepts of Walsh spectrum and Walsh transform will be studied. The Walsh 
spectrum for a real-valued dyadic stationary process Xt is defined by 


/(^) = X] R{t)W{t,x), 0 < X < oo, 


(15) 


r=0 


where the covariance function R{-) satisfies 
198lh l. Inverting (fT5l) . the covariance is given by 


MorettinI (Il974 . 


1978 . 


R{t) = / W{T,x)f{x)dx. 


The finite Walsh transform is given by 


N-l 


d^^\x) = '^2XnW{n,x), x&I. 


n=0 


To estimate the Walsh spectrum, iMorettinI (Il98lh defined the Walsh periodogram, by 


/W(a;) = Ar-i[(iW(a;)]2, 

and showed that I^^\x) is asymptotically an unbiased, but inconsistent, estimator of f{x). He 
also considered the smooth Walsh periodogram and other classes of estimates. Dyadic station- 
arity is necessary to estimate the time-varying Walsh spectrum. Therefore, in the case of local 
dyadic stationarity, it would be reasonable to divide the rescaled interval / into subintervals and 
estimate the Walsh spectrum within each subinterval, where local dyadic stationarity is satisfied. 
The number of the observations within each subinterval {u = t/T : \t/T — mo| < e} increases as 
T tends to infinity and the a bove asymptotical results still hold. A similar method is applied by 


Dahlhaus and Giraitis 


(Il998h for real-time stationary processes. 
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KohnI (Il980allbl) studied the system of Walsh functions for real time stationary processes. He 


defined the j-th logical autocovariance, r(j), and the corresponding Walsh-Fourier spectral density 
function F{x). This notation replaces the previous notation used for R{-) and /(■) above. He 
considered the finite Walsh-Fourier transform and studied its asymptotic properties. A class of 
estimators for F{x) was obtained, the average Walsh periodogram being a member of this class. 
The concept of local stationarity could also be applied in the real time setting and we conjecture 
that similar results could be obtained also in this case. 
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Appendix 


Proof of Lemma [T] Recall that p = 2™ — 1. The Walsh-ordered Hadamard matrix Hwim) is a 
(2^ X 2™') r natrix with elements of the form W{n,Xj), Xj = j/{p + 1), j,n = 0,1,... ,p, see 


also 


Stoffen (1199 ill . Then the following relations hold: 



^o®o,t,r 

^o®i,t,T • • • 

bo<Sp,t,T 


o' 

CD 

k 

o"' 

'^t,THw{xn) — 


&i®i,t,r • • • 

&l®p,f,T 


W{l,xo) 

W{l,x^) ■ 

• W(l,Xp) 


^ bpeO,t,T 

bp(si,t,T • • • 

bp(Bp,t,T j 

\ 


\ W{p,Xo) 

W{p,xi) ■ 

■ w(p, Xp) y 

= 1 

(/, Xj. 

, 1=0 

-■)} 

' (i.i) 

(l)t,T{xj_i)W{i 

- l,Xj_i) \ 

J (i 

j) 


= Hw{m) ■ diag[(j)t,T{xo), • • •, (l)t,T{xp)]. (A-1) 


But, since det[HiY{m)] = (p + ^ g, we get from (lA-ll) that 

p 

det[Si,T] = det [diag(0i,T(a:o), 0t,r(a:i), • ■ ■, (l)t,T{xp))] = JJ 0t,r(a:j). 

j=0 

For the second argument of Lemma [U note that (j)t,Tix) = x), x e I and 

every Walsh function fF(n, x), n = 0,1,..., p remains invariant for x e [xj , , Xj = j/{p + 

1), j, n = 0,1,..., p and equal to W (n, Xj). Therefore (j)t,T{x) = (j)t^T{xj), Vx G [xj, Xj^i). 


Proof of Lemma |2] 


4>t,T{^)Vt,Tix) = y^^bi^t,TW{l,x) I dm,t,TW {m, x) 


J=0 


\m=0 


E 

h=0 


^ ^ bj(^h,t,T dj^t,T 
j=0 


W{h,x). 


p p 

EE bi,t,T dm,t,TW{l © m,x) 

1=0 m=0 


(A-2) 
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In order for (j)t^T{x)rit^T{x) = 1 to hold in I, we have from equation (IA-21) that 


E 


E". 




W{h,xi) = l, l = 0,l,...,p, 


h=o L j=o 

whieh is equivalently written in matrix notation as 

/ 




Y7j=o dj^t,T 


\ 


1 


(A-3) 


\ YFj=o^j®P,t,Tdj,t,T / \ 1 y 

But = 2 ”^/ 2 m. Hence, since from assumption we have that det [Ej j'] 0, equa¬ 

tion (IA-31) gives that 

( Y.^i=oht,Tdj,t,T \ 


2^L 


2m 




di 



1 


1 


do,t,T ' 


1 


1 


0 


di,t,T 


0 

Hw{m) 


= 2”^ 




— 



U J 


U J 


\ dp^t,T ) 


U/ 


j=0 


\ Ej=obj®p,t,T dj^t,T J 


Proof of Theorem |2] Since X* ^ is locally dyadic stationary it has a Walsh spectral representation 

Xt,T= [ W{t,x)A,T{x)dU{x), 

Jo 

while Et is dyadic stationary and represented by 

£t= [ W{t,x)dZe{x). 

Jo 

Then the LHS and RHS of equation (fT^ can be written as 


LHS = bk,t,TXt^k,T — [ W{t,x) I ^ E k,t,TJ^t®k,T{x)W{k, x)\ dU{x), (A-4) 

k=0 -^0 \A;=0 / 
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and 


Set 


RHS = an,t,T£t(Bn = I W{t,x) (y^^an,t,TW{n,x)j dZ^{x). 

n=0 \n=0 / 


LHS' = / W{t,x) j2^k,t,TAt,T{^)W{k,x) dU{x). 


(A-5) 


vfc=0 


Then 


|LHS-LHS'| = I \W{t,x)\ [E \bk,t,T\ ■ \ At^k,T{x) — At^T{x) \ ■ \ W{k,x)\j dU{x) 

I / p \ 

\bk,t,T\ ■ \ At(Qk,T{^) - At^T{x)\ dU{x). (A-6) 



k=0 


Consider the interval A = {|(t 0 k/T) — t/T\ < e:}. Then, \/e, we can assume that T is large 
enough, such that t 0 k/T G A, V A; = 0,1,... ,p. From the continuity of the function A{t/T, ■) 
and assumption dS]) we have that 


\AtQ)k,T{x) - At^T{x)\ = 


At(Sk,T{x] 


-a( 


t (B k 


V T 


,x] + a( X ) - At,T{x) 


< 


< 


AtokA^) - A 

K 
T ^ 

2K 


+ 


\ T 
A 0 A; 


A 


V T 


,x^ - At^T(x) 


A 


A 0 A; \ A A 


1 ^x \ — A \ —,x 
V T ’ / VT’ 


0 


A[-,x] -AtAx) 


< ^ + e' = e''. 


(A-7) 


From (IA-61) and (IA-71) . we have that 


since 


P rl 

|LHS-LHS'| < e''J2\AtA dU{x)<e''/ 
ELo A,A < M' and dU{x) < M”, with M' and M" real constants. 
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Set 0 i, 4 ,T(a;) = Y!k=o^k,t,TW{k,x) and (/) 2 ,t,r(a:) = XlLo a;). Assume that LHS' = 

RHS. Then, since the system of Walsh functions is complete and equation (fT^ holds for t = 
1, 2,..., T, we have that 4>i^t,T{x)At^T{x)dU{x) = (j) 2 ,t,T{x)dZ^{x). 

(i) Since det[Si-r] ^ 0, from LemmafUwe have that 0i ^ ^(a;) 7 ^ 0 and from Lemma[2]there exists 
a function r]i,t,Tix) = ELo QkxrW (fc, x) such that 


Hence, 


where 


At^T{x)dU{x) = r]i^t,T{x)(l)2,t,T{x)dZe{x) 

I Ej=o ( ELo 9i,t,T aKBjxr) W(j, x)dZe(x), p < r, 
I Ej=o ( ELo 9i(BjAT ai,t,T^ W (j, x)dZ,(x), p > r. 

At^T{x)dU{x) = Kj^t,TW{j, x)dZs{x), 
j=0 


Kjxt 


'Y1^=0 9s,t,T 0,s<^j,t,Ti P < , 

J=0, 

^^s =0 9s®j,t,T (^s,t,Ti p > r, 


Therefore, 


pi M 

Xt,T = / l^(f © j, x)dZ^{x) = KjxT£t(Bj- 

j=0 "'0 j=0 


(ii) Similarly with (i). 

Proof of Corollary |2] Suppose that Xt^T = Jq At^T(x)W(t, x)dU{x). The LHS of (fTSl) is given 
by (IA-41) and the LHS' by (IA-51) . From Lemma[2l since by assumption det[St^r] 7 ^ 0, 3 ^t,T{x) = 
Y7m=o dm,t,TW (m, x), dm,t,T ^ R, such that 4>i,t,T{x)pt,T{x) = 1. Therefore, and since the system 
of Walsh functions is complete, we have that 

p 

At^T{x)dU{x) = 7]t,T{x)dZ^{x) = y2^rn,t,TW{m,x)dZ^{x). 

m=0 

Hence, Xt^T = Em=0 ^rn,t,T x)dZ^{x) = Ylm=0 dm,t,T£t(Bm- 
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